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Abstract 

Background and Objective: The SCORE scale predicts the 10-year risk of fatal atherosclerotic cardiovascular disease (CVD), 
based on conventional risk factors. The high-risk version of SCORE is recommended for Central and Eastern Europe and 
former Soviet Union (CEE/FSU), due to high CVD mortality rates in these countries. Given the pronounced social gradient in 
cardiovascular mortality in the region, it is important to consider social factors in the CVD risk prediction. We investigated 
whether adding education and marital status to SCORE benefits its prognostic performance in two sets of population-based 
CEE/FSU cohorts. 

Methods: The WHO MONICA (MONItoring of trends and determinants in CArdiovascular disease) cohorts from the Czech 
Republic, Poland (Warsaw and Tarnobrzeg), Lithuania (Kaunas), and Russia (Novosibirsk) were followed from the mid-1980s 
(577 atherosclerotic CVD deaths among 14,969 participants with non-missing data). The HAPIEE (Health, Alcohol, and 
Psychosocial factors In Eastern Europe) study follows Czech, Polish (Krakow), and Russian (Novosibirsk) cohorts from 2002- 
05 (395 atherosclerotic CVD deaths in 19,900 individuals with non-missing data). 

Results: In MONICA and HAPIEE, the high-risk SCORE >5% at baseline strongly and significantly predicted fatal CVD both 
before and after adjustment for education and marital status. After controlling for SCORE, lower education and non-married 
status were significantly associated with CVD mortality in some samples. SCORE extension by these additional risk factors 
only slightly improved indices of calibration and discrimination (integrated discrimination improvement <5% in men and < 
1% in women). 

Conclusion: Extending SCORE by education and marital status failed to substantially improve its prognostic performance in 
population-based CEE/FSU cohorts. 
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Introduction 

The SCORE (Systematic COronary Risk Evaluation) scale is a 
widely used instrument for predicting the risk of future cardiovas- 
cular disease (CVD) across European populations [1]. It estimates 
the 10-year risk of cardiovascular mortality based on age, gender, 
blood lipids, blood pressure (BP), and smoking, in 40-65-year-olds 



free of manifested CVD. Two versions of SCORE were created 
for high- and low-risk European countries. The European Society 
of Cardiology (ESC) recommends applying the high-risk SCORE 
to the populations of Central and Eastern Europe (CEE) and 
former Soviet Union (FSU) [2], although this version was derived 
without reference to local data. 
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As SCORE includes only conventional cardiovascular risk 
factors, there have been ongoing attempts to improve its 
performance by adding resting heart rate [3], high-density 
lipoprotein cholesterol [4], and other factors [5,6] to the model. 
Across CEE/FSU populations, the majority of which still face high 
levels of fatal CVD [7], pronounced and increasing socioeconomic 
and sociodemographic differentials in all-cause and cardiovascular 
mortality have been reported [8-10]. Moreover, education and 
marital status have been shown to independently predict 
cardiovascular risk in CEE/FSU populations [11-13]. These 
two easily and routinely assessed parameters reflect different 
pathways between social circumstances and CVD. Education can 
act via life-style behaviours, problem-solving abilities, and 
acquisition of positive social, psychological and economic skills 
and assets [14,15], while marital status can affect CVD risk 
through social connections, a sense of social and familial role, 
socioeconomic support, and facilitation of health-promoting 
behaviours [16-19]. Therefore, education and marital status are 
likely candidates for inclusion in cardiovascular risk models, 
together with conventional risk factors. However, to the best of our 
knowledge, the prognostic performance of CVD risk scales 
extended by these characteristics, or other socioeconomic and 
sociodemographic parameters, has not been assessed in CEE/ 
FSU. 

The aim of our study was to investigate whether SCORE 
calibration and discrimination improve after extension by such 
social indicators as education and marital status, using two sets of 
population-based CEE/FSU cohorts. 
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Methods 

Study Population and Samples 

We used the data from two international multi-centre studies — 
the World Health Organization (WHO) MONICA (MONItoring 
of trends and determinants in CArdiovascular disease) Project 
[20,21] and HAPIEE (Health, Alcohol, and Psychosocial factors 
In Eastern Europe) study [22]. 

The WHO MONICA Project monitored the trends in CVD 
rates and risk factors in 38 populations from the mid-1980s to at 
least the mid-1990s [20,21]. Risk factors were assessed in random 
population samples of men and women aged 35-64. In some 
centres, the study samples were followed for mortality. We 
obtained the baseline data and the data on subsequent 10-year 
mortality for the following MONICA samples: the Czech sample 
from six country districts examined in 1992; Polish Warsaw and 
Tarnobrzeg samples screened in 1983-84 and 1987-89; Lithua- 
nian Kaunas samples examined in 1983-85, 1986-87, and 1992- 
93; and Russian Novosibirsk samples screened in 1985-86, 1988- 
89, and 1994—95. The numbers of subjects and response rates are 
shown in Table 1. At baseline, participants completed a 
questionnaire survey, underwent a clinical examination, and 
provided a blood sample. The mortality follow-up used the data 
from national and local mortality registers [20,21]. 

HAPIEE is a multi-centre study of CVD and other chronic 
conditions in CEE/FSU [22]. It follows random population 
samples of men and women aged 45-69 at baseline (2002-05) 
from the Czech Republic (Havifov/Karvina, Hradec Kralove, 
Jihlava, Kromefiz, Liberec, and Usti nad Labem), Poland 
(Krakow), Russia (Novosibirsk), and Lithuania (Kaunas). The four 
cohorts have been followed for cause-specific mortality and non- 
fatal CVD. As the Lithuanian cohort was established several years 
later and had fewer CVD deaths, it was not included in our 
analyses. The baseline data collection included a structured 
questionnaire survey and physical examination, with a fasting 
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venous blood sample collection. In Czech and Polish HAPIEE, the 
study questionnaire was completed at home, prior to medical 
examination in a clinic. This explains the smaller proportion of 
Czech and Polish participants with non-missing data. Mortality 
data come from national (the Czech Republic) and local (Poland 
and Russia) registers [22]. 

As SCORE predicts cardiovascular risk in individuals over 40 
and without pre-existing atherosclerotic CVD [1], we excluded 
subjects aged <40 at baseline and those with medical evidence or 
a self-reported history of doctor-diagnosed myocardial infarction, 
angina, or stroke. Overall, data on conventional, SCORE- 
comprising risk factors, education, and marital status were 
available for 14,969 MONICA subjects and 19,900 HAPIEE 
participants (Table 1). 

Ethics Statement 

The MONICA protocol was approved by the local ethics 
committees in each participating country: the Institute of Clinical 
and Experimental Medicine Ethics Committee (Prague, the Czech 
Republic), the National Institute of Cardiology Ethics Committee 
(Warsaw, Poland), the Jagellonian University Ethics Committee 
(Krakow, Poland), the Kaunas University Ethics Committee 
(Kaunas, Lithuania), and the Institute of Internal and Preventive 
Medicine Ethics Committee (Novosibirsk, Russia) [20]. The 
HAPIEE protocol was approved by the University College 
London/University College London Hospital Ethics Committee 
(London, UK) and by local ethics committees at each study centre: 
the National Institute of Public Health Ethics Committee (Prague, 
the Czech Republic), the Jagellonian University Ethics Committee 
(Krakow, Poland), and the Institute of Internal and Preventive 
Medicine Ethics Committee (Novosibirsk, Russia) [22]. Both 
studies were conducted according to the standards of the 
Declaration of Helsinki. All participants provided written informed 
consent. 

Measurements 

The SCORE risk predictors include age, sex, smoking status, 
total cholesterol (TC), and systolic BP (SBP). The measurement of 
these parameters in MONICA and HAPIEE participants is 
described in detail elsewhere [20,22,23]. Individuals currendy and 
regularly smoking at least one cigarette per day were regarded as 
current smokers; never and ex-smokers were considered non- 
smokers, according to the SCORE criteria [1]. SBP and TCH 
measurement was subjected to extensive quality control. 

In the original categories of education and marital status (five 
and four categories, respectively), the numbers of atherosclerotic 
CVD deaths were not sufficient for adequately powered analyses. 
Therefore, these factors were dichotomised and defined as 
"higher" (university, secondary, or vocational) vs. "lower" 
(primary or less) education and "married" (married/cohabiting) 
vs. "non-married" (single, divorced/separated, or widowed) status. 
In line with the SCORE end-points [1], the study outcome was 
atherosclerotic cardiovascular death (International Classification 
of Diseases (ICD) 9 codes: 401-414, 426-443 (except 426.7, 429.0, 

430.0, 432.1, 437.3, 437.4, and 437.5), 798.1 and 798.2; ICD-10 
codes: 110-115, 120-125, 144-173 (except 145.6, 151.4, 152, 160, 162, 

167.1, 167.5 and 167.7), R96.0, and R96.1). 

Statistical Analyses 

The high-risk version of the SCORE scale, recommended by 
the ESC for CEE/FSU populations [2], was used to predict the 
risk of fatal atherosclerotic CVD in all MONICA and HAPIEE 
samples. The recendy introduced Czech and Polish SCORE 



versions were not used, as they lack a detailed description of their 
development and recalibration [24,25]. 

The prognostic performance of risk prediction scales, such as 
SCORE, could be assessed via calibration and discrimination 
[26,27]. Calibration reflects the closeness between predicted and 
observed risks. Discrimination shows how accurately the partic- 
ipants who will experience events (such as fatal CVD) during the 
follow-up are separated from those who will remain event-free. 
Better calibration and discrimination are denoted, respectively, by 
lower % values and higher jft-values in the Hosmer-Lemeshow test 
[28] and higher values of the Harrell's C-statistic [29]. The 
additional prognostic information, provided by extra risk predic- 
tors, could be assessed in likelihood ratio tests (LRT). Lower LRT 
/(-values denote more pronounced differences between the nested 
baseline and extended models and, hence, better predictive 
performance of the latter. More clinically relevant parameters of 
risk reclassification are net reclassification index and integrated 
discrimination improvement (IDI). As our additional risk factors 
were dichotomized and, therefore, specific to MONICA and 
HAPIEE samples, we used IDI, which is relatively independent of 
risk thresholds and categories and reflects the extended model's 
ability to improve average sensitivity without compromising 
average specificity [30,31]. 

We analysed the prognostic ability of the extended SCORE 
separately for men and women in each MONICA and HAPIEE 
sample. First, we explored the role of SCORE, education, and 
marital status as fatal CVD predictors, using Cox regression 
models. We then investigated calibration and discrimination of the 
SCORE extended by education and marital status, calculating 
Hosmer-Lemeshow %\ Harrell's C, LRT p, and IDI. The SCORE 
performance was compared for the baseline Model 1 (SCORE 
only) vs. Model 2 (SCORE and education), Model 3 (SCORE and 
marital status), and Model 4 (SCORE, education, and marital 
status). 

The use of Cox proportional hazards regression models was 
justified by the high /(-values in Schoenfeld's test. The data from all 
MONICA waves were pooled within samples, as the SCORE-fatal 
CVD association demonstrated no evidence of confounding by or 
statistical interaction with the study wave. The competing-risk 
regression analyses [32], accounting for the risk of death from 
causes other than atherosclerotic CVD, produced very similar 
results (not presented) to those of the standard Cox analyses. No 
significant interactions between SCORE and additional risk 
factors were detected. Simultaneously extending SCORE by 
education and marital status was possible, due to low values of phi 
correlation coefficient (not presented). To enable comparisons 
between non-extended and extended models, the analyses 
included only subjects with known values of conventional and 
additional risk factors. Additional sensitivity analyses used multiply 
imputed data for the samples with the highest proportion of 
missing baseline SCORE values - Czech MONICA, Lithuanian 
MONICA, Czech HAPIEE, and Polish HAPIEE. The imputation 
model, which was based on the chained equations approach [33] 
and generated 10 imputations, included SCORE, education, 
marital status, atherosclerotic CVD death, and logarithm of 
survival time. 

The SCORE calibration in HAPIEE was affected by the fact 
that the current follow-up of HAPIEE samples is less than 1 0 years 
(Table 2). However, we focused on the changes in calibration 
after the SCORE extension by education and marital status, 
rather than on SCORE calibration per se. As the Hosmer- 
Lemeshow test quantifies the agreement between predicted and 
observed events across risk deciles, it was applied to the non- 
dichotomised SCORE, which treats individual levels of absolute 
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risk (percentages in the respective SCORE chart cells) as a 
continuous variable. All statistical analyses were performed using 
Stata/IC 12.0 (StataCorp LP, Texas, USA). 

Results 

Description of the Study Samples 

The baseline characteristics of our analytical samples are 
presented in Table 2. The mean age of participants was close 
to 52 years in MONICA and 57 years in HAPIEE, with relatively 
similar sizes of the five-year age groups. Smoking prevalence was 
high in both studies, with the exception of MONICA women from 
Tarnobrzeg, Kaunas, and Novosibirsk. Czech and Polish men 
participating in HAPIEE smoked less than their MONICA 
counterparts. By contrast, among Russian women, smoking 
prevalence was higher in HAPIEE than in MONICA. In both 
studies, mean levels of TC were close to 6 mmol/1 and tended to 
be slightly higher in women. The highest mean SBP levels, 
exceeding 140 mm Hg, were observed for MONICA participants 
from Warsaw and Czech HAPIEE men. The proportion of lower- 
educated people was markedly higher in MONICA than in 
HAPIEE. In both studies, the majority of participants were 
married. The median follow-up duration was 10 years in 
MONICA and 6.2-8.2 years in HAPIEE (Table 2). The highest 
percentage of atherosclerotic CVD deaths was observed for 
Russian MONICA and HAPIEE men. In women, the observed 
risk of fatal CVD was lower, but reflected the same ranking. 

SCORE, Education, and Marital Status as Predictors of 
Fatal Atherosclerotic CVD 

As shown in Tables 3 4, in most MONICA and HAPIEE 
samples, the high-risk SCORE >5% at baseline was a significant 
predictor of atherosclerotic CVD mortality, both before and after 
controlling for education, marital status, or both (adjusted hazard 
ratios (HR) 1.5-5.8 for MONICA and 2.7-8.5 for HAPIEE). After 
is c adjustment for SCORE, a significant association between fatal 



5 2 



5 QJ 



CVD and education was demonstrated in four out of eight male 
MONICA and HAPIEE samples; for the association between fatal 
CVD and marital status, this figure was five out of eight (Table 3). 
For female MONICA and HAPIEE samples, the respective figures 
were three out of eight and one out of eight (Table 4). 

Calibration and Discrimination of SCORE Extended by 
Education and Marital Status 

In most MONICA samples, the extension of SCORE by 
education slighdy reduced Hosmer-Lemeshow's % 2 values, which 
indicated a modest improvement in the SCORE calibration 
^ (Tables 3-4). The addition of marital status to SCORE improved 

£ | calibration only in Czech men, Polish women from Tarnobrzeg, 

1 °- and Lithuanian women. Across most HAPIEE samples, adding 

o S education and marital status to SCORE somewhat improved its 

J, e calibration. 

pj; £ g A slight increase in Harrell's C-statistic was observed for 

S s § MONICA and HAPIEE men and women, once education and 

J |~ g> marital status were added to SCORE. According to the LRT 

5 •§ g results, the extended SCORE demonstrated improved discrimi- 

h « £ nation in some MONICA and HAPIEE samples. However, in 

<j 2 P- both studies, the values of IDI were <5% in men and £1% in 

□ » E women, which suggests a modest improvement in SCORE 

2£ S. &■ performance. 

u Overall, calibration and discrimination of the original, non- 

u ° 5 extended SCORE appeared to be similar, or only marginally 

n ij | worse, compared to the SCORE modifications extended by 

education and/or marital status. 
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.ai Discussion 

re 

"a. To the best of our knowledge, this is the first attempt to assess 

™ the prognostic performance of SCORE extended by education 

§ and marital status in CEE/FSU. The high-risk SCORE signifi- 

< cantly predicted atherosclerotic cardiovascular mortality in two 

z . sets of population-based cohorts, both before and after adjustment 

ffl for additional risk factors. Education and marital status were 

~ significandy and independently from SCORE associated with fatal 

^ CVD in some samples. However, adding these factors to SCORE 

8 did not substantially improve its calibration and discrimination, 

J; which justifies the use of the original, non-extended scale. 

§ Strengths and Limitations 

c Several methodological issues should be considered when 

E interpreting our results. First, we used the data from two separate 

| studies, which covered different historical periods, characterized 

E by major albeit heterogeneous changes in several domains: 

g conventional cardiovascular risk factors (for example, smoking 

re prevalence declined among Czech men, while it increased among 

E Russian women [34]); socioeconomic and sociodemographic 

.1 characteristics (such as improved educational attainment [7], but 

-d also rising income inequalities and decreasing proportion of 

2 married/ cohabiting people [35]); and diverging trends in cardio- 

6 vascular mortality after 1990 [7], which cannot be explained by 

7 the change from the ICD-9 to ICD-10 classification in the late 
Q 1990s [36-41]. We acknowledge that, since our data come from 
■2 two sets of studies in population samples, our estimates of a longer- 
=! term mortality risk may not fully represent the trends in national 
1 rates. 

% Second, although MONICA and HAPIEE samples are not 

I representative for the whole countries (for example, they are 

re predominantly urban), they are the best available CEE/FSU 

~ sources of individual-level cohort data on the levels of CVD risk 

re factors and mortality in the 1980-2000s. The comparability of 

°- MONICA and HAPIEE data was high, due to the similarity of the 

g study protocols. 

5? Third, as in most epidemiological studies, both MONICA and 

g> HAPIEE participants tended to be healthier and more affluent 

h than non-responders. This potential discrepancy could be 

E enhanced by the complete case analyses and dilute the association 

— of interest. The available multiple imputation methods use the 

_§ assumption of data missing (completely) at random [42,43]. 

a. However, this assumption was unlikely to be met in our samples, 

h as suggested by the typically higher levels of total and CVD 

q! mortality across study- and country-specific subgroups with 

? missing vs. available SCORE. While excluding the observations 

"re with non-randomly missing values is not entirely bias-free, in our 

~ sensitivity analyses the Cox regression results across the samples 

re with the highest SCORE missingness were similar for complete 

S. and multiply imputed data (not presented). Therefore, the possible 

£ selection bias due to non-response and SCORE missingness and 

^ 8 g the resulting potential underestimation of the strength of the 

'E -S § association between CVD risk factors and mortality were unlikely 

|rm to be substantial. 

7 -= g Fourth, education and marital status are only two parameters 

out of the wide range of social indicators which potentially 
influence CVD risk. For example, material deprivation may have 
strong effects on cardiovascular mortality [44,45]. However, we 
focused on education and marital status, as they are collected in 
most epidemiological and clinical studies and are easily measur- 
able, even in the primary care settings. Moreover, education and 
marital status reflect different pathways between social circum- 
stances and CVD, and they have both been shown to indepen- 
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dently predict cardiovascular risk across CEE/FSU populations 
[11—13]. The dichotomisation of education and marital status, 
while increasing the risk of residual confounding, was necessary in 
order to obtain sufficient numbers of atherosclerotic CVD deaths 
across exposure categories (see Methods). The marked decrease 
in the prevalence of lower education between MONICA and 
HAPIEE cohorts (for example, from 64% in Czech MONICA 
men to 5% in Czech HAPIEE men) reflects improved access to 
further education in more recent birth cohorts [7], as well as the 
urban nature of the HAPIEE cohort (Czech MONICA sample 
was not exclusively urban). Some differences in the contextual 
meaning of lower education or non-married status across countries 
and over time, specifically in terms of their influence on 
cardiovascular risk, are possible. Nonetheless, these potential 
differences were unlikely to substantially affect the magnitude of 
the associations between socioeconomic parameters, SCORE, and 
fatal CVD, as our analyses were study- and country-specific. 

Finally, the baseline levels of conventional and additional risk 
factors were likely to change during the follow-up period and, 
therefore, result in potential regression dilution bias, or underes- 
timation of the association of interest [46]. However, the 
estimation of the future outcome risk based on the current 
exposure levels agrees with the general concept of risk prediction. 

Consistency with other Studies 

The validity of our findings, despite the potential limitations 
discussed above, is supported by the fact that the levels of major 
risk factors and CVD mortality in MONICA and HAPIEE 
samples reflect the respective national cross-sectional estimates and 
trends presented in the WHO Global InfoBase [34] and WHO 
systematic reviews and reports [47-49] . 

SCORE significantly predicted cardiovascular risk, indepen- 
dently of social characteristics, not only across MONICA and 
HAPIEE samples, but also in adults from Austria [50] and Greece 
[51]. In most MONICA and HAPIEE samples, lower education 
and non-married status were linked to an increase in CVD risk 
even after controlling for SCORE. This agrees with the results for 
male participants of the Russian Lipid Research Clinics (LRC) 
Study [11] and MONICA-Novosibirsk [12], as well as with the 
findings from USA [52,53], Finland [54], the Netherlands [55], 
and UK [18,56,57]. 

The lack of statistically significant, SCORE-independent 
associations between fatal CVD and education or marital status 
in most MONICA and HAPIEE samples could be pardy 
explained by the limited numbers of atherosclerotic cardiovascular 
deaths. Moreover, the mechanisms of adverse effects of lower 
education and non-married status on cardiovascular health involve 
conventional risk factors, such as smoking [56]. Controlling for 
these factors, captured by SCORE, might over-adjust the 
association between education, marital status, and CVD mortality. 

There is an extensive evidence of a marked and increasing social 
gradient in all-cause and cardiovascular mortality in CEE/FSU 
populations [8-10,12,58]. Therefore, we hypothesized that 
% § education and marital status, once added to conventional risk 

§, m factors, would improve the cardiovascular risk prediction in CEE/ 

* 8 FSU. However, in both MONICA and HAPIEE, the SCORE 

3 °. ...... . . 

o calibration and discrimination were very similar for the original 

| % (non-extended) scale and for the scale extended by education and 

S E marital status. 

3 

£ While we did not find relevant external evidence from CEE/ 

<u jjj FSU, several American and British studies reported no or minimal 

a 5 improvement in the performance of the Framingham coronary 

5 '5 risk scale extended by various socioeconomic parameters [59-61]. 

Other studies have shown a better prognostic performance of the 
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cardiovascular risk scales incorporating socioeconomic character- 
istics (such as ASSIGN and QRISK/QRISK2), compared to 
traditional instruments (such as the Framingham scale), but they 
assessed non-nested models [62-67] and, therefore, could not 
directly address the issue of incremental prognostic value of 
socioeconomic parameters. In this respect, our results are 
consistent with the negative findings from the studies that used 
nested models [59-61]. 

Conclusions 

Our main finding - little improvement in the SCORE 
prognostic performance after inclusion of education and marital 
status - has several implications. First, our study supported the use 
of the original, non-extended SCORE in CEE/FSU populations 
and, therefore, confirmed the important role of conventional risk 
factors. Controlling them at both the population and individual 
levels should reduce the CVD burden in CEE/FSU and prevent 
the reversal of declining CVD rates elsewhere [2,68,69] . Second, 
other sociodemographic and socioeconomic parameters, such as 
area-level deprivation, when added to SCORE separately or in 
combination, could independently predict fatal CVD and have 
incremental prognostic value in specific populations. However, if 
these parameters are to be routinely used, they need to be easily 
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